A client of Sharp Decisions Inc. is looking for an IT Data Integration Engineer / AWS DataEngineer to be based in Torrance, CA. This position is HYBRID (3 days a week onsite). The contract duration is 6 months with possible extension.*W2 only.
JOB DESCRIPTION:
The IT Data Integration Engineer / AWS Data Engineer is tasked with the design, development, and management of data integration processes to ensure seamless data flow and accessibility across the organization. This role is pivotal in integrating data from diverse sources, transforming it to meet business requirements, and loading it into target systems such as data warehouses or data lakes. The aim is to support the organization's data-driven decision-making by providing high-quality, consistent, and accessible data.
DAILY TASKS:
Develop and Maintain Data Integration Solutions:
Design and implement data integration workflows using AWS Glue/EMR, Lambda, Redshift
Demonstrate proficiency in Pyspark, Apache Spark and Python for data processing large datasets
Ensure data is accurately and efficiently extracted, transformed, and loaded into target systems.
Ensure Data Quality and Integrity:
Validate and cleanse data to maintain high data quality.
Ensure data quality and integrity by implementing monitoring, validation, and error handling mechanisms within data pipelines
Optimize Data Integration Processes:
Enhance the performance, optimization of data workflows to meet SLAs, scalability of data integration processes and cost-efficiency on AWS cloud infrastructure.
Identify and resolve performance bottlenecks, fine-tuning queries, and optimizing data processing to enhance Redshift's performance
Regularly review and refine integration processes to improve efficiency.
Support Business Intelligence and Analytics:
Translate business requirements to technical specifications and coded data pipelines
Ensure timely availability of integrated data for business intelligence and analytics.
Collaborate with data analysts and business stakeholders to meet their data requirements.
Maintain Documentation and Compliance:
Document all data integration processes, workflows, and technical & system specifications.
Ensure compliance with data governance policies, industry standards, and regulatory requirements.
EDUCATION AND REQUIREMENTS:
Bachelor's degree in computer science, information technology, or a related field. A master's degree can be advantageous.
7-10+ years of experience in data engineering, database design, ETL processes,
5+ in programming languages such as PySpark, Python
5+ years of experience with AWS tools and technologies (S3, EMR, Glue, Athena, RedShift, Postgres, RDS, Lambda, PySpark)
3+ years of experience of working with databases/ data marts/data warehouses
Proven experience in ETL development, system integration, and CI/CD implementation.
Experience in complex database objects to move the changed data across multiple environments
Solid understanding of data security, privacy, and compliance.
Excellent problem-solving and communication skills.
Display good communication skills to effectively collaborate with multi-functional teams
Participate in agile development processes including sprint planning stand-ups and retrospectives
Provide technical guidance and mentorship to junior developers
Attention to detail and a commitment to data quality.
Continuous learning mindset to keep up with evolving technologies and best practices in data engineering.
Take the leap to a rewarding job that pays you well and that you enjoy.
Success Stories
Habib Karbasian
Data Scientist at Neal Analytics
“I was ready to give up [on the job search point] and I was at my lowest point...fortunately,
HiCounselor was my last resort and they walked me through every step of the interview process.
The program was the light at the end of the tunnel [for me], and I landed a job within 1 month”
Wei Yuan
Business And Data Analyst
“Before joining HiCounselor I felt like I was spinning my wheels. Applying to jobs online with no
networking and no focus.Thanks to HiCounselor's training and networking, I learned how to network
and turn leads into offers!”
EMIL JOSWIN
Software Engineer at Habu
“When it comes to HiCounselor, the biggest plus is that they will do the networking on your behalf,
which in my experience saved 95% of my time and energy. I was able to then channel my time and energy
into being prepared for interviews.”
To help us tailor your experience, please let us know
what
you're looking for :
Will you require visa sponsorship to work in US?
What Job Roles you are interested in?(Select one or
more)
How would you define yourself?
How many years of Professional Experience do you have?
(Select one)
What is your location preference for the job
Looking for job opportunities or internships
LinkedIn OR Resume
Based on your provided information, we can help you with
the following:
Join HiCounselor Career Accelerator Program, where
we will help you with interview preparation and
connecting with you the right job opportunities
Click
here to sign up for the Info Session today or you
can also fill out the application on the next step.
HiCounselor Projects Platform:
Complete Real World Projects to help you learn and get
ready for the job you want and Build professional
portfolio.
Based on your provided information, we can help you with
the following:
Actively hiring companies in
HiCounselor partners with companies hiring in ,
Select this option to get redirected to see the job
opportunities in
HiCounselor Projects Platform:
Complete Real World Projects to help you learn and get
ready for the job you want and Build professional
portfolio.
Based on your provided information, we can help you with
the following:
We recommend you to attempt real world projects on
HiCounselor Projects platform to get ready for
internships.
Once you have your portfolio built, visit this
page, where
we have listed startups whom you can reach out for
internships.
https://discord.gg/GUPad7ETad